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PREFACE 



THIS STUDY is a technical appendix to J. P. Stucker and G. R. Hall, 

The Performance Contracting Concept , The Rand Corporation, R-699/1, 

May 1971. That Report discusses basic issues and considerations in 
using the performance contracting method of organizing educational 
programs, and is addressed to educational decisionmakers, particu- 
larly those guiding local school districts. This Appendix summarizes 
the mathematical models that have been developed to analyze contrac- 
tual relationships and incentives, and will be of interest primarily 
to theoreticians and analysts rather than educational administrators. 

Two further Rand reports on performance contracting are scheduled. 
One will analyze the operations and effects of some programs being 
conducted during the 1970-71 school year. Thp final report will be 
a Performance Contracting Guide, a general guide on how to plan, 
conduct and evaluate performance contracting programs. All three 
reports are part of Rand's study of performance contracting in educa- 
tion sponsored by the Assistant Secretary for Planning and Evaluation 
of the United States Department of Health, Education and Welfare 
pursuant to Contract No. HFW-OS -70-156 . 
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SUMARY 



THIS TECHNICAL APPENDIX summarizes the major theoretical articles 
bearing on the theory of performance contracting. No general , de- 
finitive statement of that theory has been found, but most of the 
major elements of the theory are presented. Two especially perti- 
nent contributions are reviewed: n A Formal Theory of the Employment 

Relationship, 11 an article by H. A. Simon, and Optimal Rewards In 
Incentive Systems , a Ph.D. dissertation by G. M. Yowell, Jr. These 
analyses could provide a inundation for a fully articulated theory 
of performance contracting. 

All the other articles reviewed are concerned with the theory 
of incentives for cost reduction. This theory, usually discussed in 
the context of the federal Government and defense contractors, is 
simply a specialization of the general theory of incentives, and 
several of it, 5 assumptions are so restrictive that they severely 
limit its application to most performance contracting situations. 

Simon investigates the possible tradeoffs in the choice between 
a sales contract (a contract for results) and an employment contract 
(a contract for labor resources). He points out that uncertainty is 
the major factor in these tradeoffs, and that the reduction of un- 
certainty achieved by delaying certain decisions is the major 
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advantage of an employment contract over a sales contract. His dis- 
cussion can easily be rephrased to deal with the choice between a 
fixed contract, where all production decisions are made prior to 
signing the contract, and performance contracts, where some decisions 
may be deferred . 

The theory of contracting is concerned with the choice beLween 
a sales contract and an employment contract. The theory of incentives 
is concerned with a choice that is applicable to either type of con- 
tract; its focus of interest is on methods for indirectly guiding 
the actions of the agent--a worker or contractor. The agent is not 
commanded to perform a specific action (or produce a specific product), 
but is given a range of choice. The employer (principal) attempts to 
influence the agent's choice by setting up a differential payment 
scale for the various actions that is biased in favor of the employer's 
(principal's) desires, 

Yowell formulates a general decision-theoretic incentive model 
and investigates its properties under several sets of assumptions, 
including certainty and uncertainty. The incentive relationship he 
studies includes only two parties. Thio relationship is further 
simplified for purposes of analysis so that the payoff to tne prin- 
cipal results exclusively from the action of the agent, while the 
agent's reward is determined solely by the principal according to 
the perceived results of the agent's actions. Yowell assumes that 
the basic relationship between the two parties is formed for the 
benefit of both, and investigates the extent to which the principal 
can guide the agent's actions by establishing rewards conditional on 

ERIC 
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the results ti.e agent achieves. Thus a prime characteristic of the 
approach is the l>ee choice of action by the agent. The basic 
assumption that endows the principal with control over the agent's 
action is that the agent maximizes his profit (or, in the case of 
uncertainty, his expected utility). Rewards for results coupled 
with this profit -maximizing behavior allow the principal to influence 
the behavior of the agent without, at the same time, restricting the 
agent's free choice of action. 

Yowell is able to prove the existence of optimal reward func- 
tions in most situations. More important, he shows that risk pref- 
erences are the critical factors in deriving reward functions, and 
that when the principal and the agent share a common belief con- 
cerning the joint probability of outcome and cost, the optimal re- 
ward function is a simple additive function of 1) the agent's cost 
and 2) a linear function of joint profits. 

To our knowledge, however, the theory of contracting and the 
theory of incentives have never been integrated. Simon’s work is 
based on the assumption that it may be advantageous to defer produc- 
tion decisions. The theory of incentives, although it is based on 
the agent's freedom of choice, concerns itself only with situations 
where he makes h if, production decisions early in the contract and, 
we must assume, never alters his plans. Thus, the only interesting 
aspect of the theory is the selection of an (optimal) reward function 
and under these conditions, the only point of interest on the reward 
function is the point corresponding to the principal's preferred 
outcome. 
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If the theory of incentives were broadened to include the 
agent's response to unforeseen events, it would become much richer 
and more realistic, and could be used as a theory of performance 
contracting. In Section II of R-699/1, The Performance Contracting 
Concept , we attempt to synthesize these thoughts on the theory of 
{ contracting, the theory of incentives, and the integration of the 

two t.aories, into the outline of an informal statement of the 
theory of performance contracting. 
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X , INTRODUCTION 



A CONTPACT is a legal agreement between two parties in which one 
party promi \~;S to perform some specif ic act or acts in return for 
a consideration of value from the other. Every contract has the 
performc-rce a f a promise as its essence, and most contracts contain 
specific redress to cover nonperformance. There are two basic dis- 
tinctions between types of contracts. The first is whether the 
contract calls for the provision of resources or the provision of 
results. The crucial distinction between these types of contracts 
is whether the principal party buys the resources and then directs 
their utilization achieve some desired results, or whether he 
contracts directly for the results. The second distinction is 
whether the contract specifies a single acceptable outcome nnd a 
single acceptable payment, or a range of acceptable oi tcomes and 
payments. Contracts that allow for a range of acceptable outcomes 
and specify a range of payments corresponding to these outcomes 
are termed performance or incentive contracts. 

Performance contracting is not a novel concept. For centuries 
people have been rewarded according to their per for nance--that is, 
according to the effort they expend or the results they produce. 

Our review of the literature, however, has produced no comprehensive 
theoretical statement concerning the benefits and costs of performance 
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contracting as compared with other types of contracting. There are 
apparently no general models dealing with the tradeoff relationships 
between contracts for resources and contracts for results, and be- 
tween fixed contracts, where all production decisions are made prior 
to signing the contract, and performance contracts, where some 
decisions may be deferred. 

The literature does contain an important article, however, 
that provides a foundation for a theory of contracting by investi- 
gating the advantages and disadvantages of delayed decisionmaking. 

The literature also contains some refined statements concerning pricing 
or reward functions for use in a performance contract. In this tech- 
nical appendix ve review the main articles in these fields and suggest 
how they might be synthesized into a theory of performance contracting. 
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II . THE THEORY OF CONTACTIN G 

THE SALIENT ARTICLE on the theory of contracting is by H, A. Simon, 
who discusses the conditions under which two parties will find it 
mutually advantageous to enter into an employment contract rather 

iV 

than a sales contract. In the terminology of the present Report, 
the choice is between contracting for resources and contracting for 
results . 

Simon's approach is to discuss the authority relationship that 
exists between an employer B (for "boss 11 ) and an .employee W (for 
"worker") , The collection of specific actions that W performs on 
the job (typing and filing letters, laying brick) are called his 
behavior . The set of all possible behavior patterns of W con- 
sidered, and x is used to designate an element of this set. A 
particular x might then represent a given set of tc-iks, performed 
at a particular rate of working, a particular level of accuracy, 
and so forth. 

B is said to exercise authority over W if f V permits B to select 
x. That is, W accepts authority when his behavior is determined by 
B f s decision. In general, W will accept authority only if x°, the 

H. A, Simon, "A Formal Theory of the Employment Relationship," 
Econometr ica , Vol. 19, No. 3, July 195), pp. 293-305, 
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x chosen by B, is restricted to some given subset (W's ’'area of 

acceptance") of all the possible values. 

W enters into an employment contract with B when he agrees to 

accept B’s authority and B agrees to pay W a stated wage (r). This 

form of contract differs fundamentally from a sales contract. In a 

sa les contract each party promises a specific consideration in return 

for the consideration promised by the other. The buyer (like B) 

promises to pay a stated sura of money; but the seller (unlike W) 

promises a specified commodity in return. Moreover, the seller is 

not interested in the way in which his commodity is usea ones it is 

sold while the worker is interested in what the entrepreneur will 

want him to do (which x will be chosen by B), 

We notice that certain services are obtained by buyers in 
our society sometimes by a sales contract, sometimes by an 
employment contract. For example, if I want a new concrete 
sidewalk, I may contract for the sidewalk or I may employ 
a worker to construct it for me,* 

Simon postulates that the employer and the employee are interested 
in maximizing their respective ’’satisfaction functions": 



( 1 ) 

where 



S b ~ S t>( x > r ) “ S bi^ x ^ + S b2^ 



Sbf(x) ^ 0 and S^(r) ^ 0, and 



( 2 ) 

where 



S w = V x * r> “ S wl< x > + S w2 ( '- ) 



S ^ 0 and S^fr) 2 ® 



The problem, then, is for the two parties to 1) agree upon a 
mutually acceptable outcome (x°,r°) and enter into a sales contract, 



Ibid., p,29'*. 
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or 2) to agree cn a wage (r°) and enter Into an employment contract 
whereby B is abla to select unilaterally (at some later time) the 
action W must perform. 

Simon then demonstrates that: 

A, When the satisfactions to be derived from each possible 

action are known with certainty, the rational procedure for B and W 

is first to determine a preferred x, and then proceed to bargain 

about r so as to fix S and S ; that is, they should arrive at a 

J w 

sales contract of the ordinary kind in which W agrees to perform a 

o . - , .o 

specific, determinate act x m return ror an agreed upon price r . 

B, When the satisfactions to be derived from each possible 
action are not known with certainty, and when both B and W act to 
maximize their expected satisfactions, the preferability of an 
employment contract over a sales contract increases 1) as the range 

of the expected satisfactions for the different actions decreases 

k 

and 2) as the uncertainty of the satisfactions increases. 

Simon’s results are derived from a very restrictive model, but 
they are intuitively appealing. It is unfortunate that no one has 
investigated these relationships in a more general context. 

Simon's work has three important implications for performance 
contracting : 

1) The basic issue in considering a performance contract for 
results is whether it is or is not preferable to a contract for 
resources . 

2) The basic distinction between the two types of contracts 
is authority relationships. 




*IUid., p. 301. 
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3) The preferred choice between the two basic contracts is, 



in part, a function of the uncerta*nty connected v/ith the project. 
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I I I . THE GENERAL THEORY OF INCENTIVES 



SIMON'S ARTICLE on contracting is concerned with the choice between 
a sales contract and an employment contract. The theory of incen- 
tives is concerned with a choice that is applicable to either type 
of contract; its focus of interest is on methods for indirectly 
guiding the actions of the agent--a worker or contractor. The agent 
is not commanded to perform a specific action (or produce a specific 
product), but is given a range of choice. The employer (principal) 
attempts to influence the agent's choice by setting up a differential 
payment scale for the various actions that i3 biased in favor of the 
employer's (principal's) desires. 

By far the best general statement of the incentive problem is 

* 

found in G. M. Yowell 'c Optimal Rewards in Incentive Systems . We 
shall restate Yowell's model, the assumptions it requires, and the 
theorems he derives. This general framework will then be used in 
the following section to discuss the work on incentives for cost 
reduction . 

Yowell formulates a general decision-theoretic incentive model 
and investigates its properties under several sets of assumptions, 

* 

G, M, Yowell, Jr., Optimal Rewards in Incentive Systems , EES 
Studen.- Thesis Series, Department of Engineering Economic Systems* 
Stanford University, Stanford, Calif., March 1969. 
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including certaiaty and uncertainty. The incentive relationship he 
studies is the simplest possible, comprising only t<70 parties; it 
could represent, for example, a manager and a subordinate, the 
government and a contractor, or society at large and the individual. 
For convenience, the first party is referred to as the principal and 
the second party as the agent. This relationship is simplified for 
purposes of analysis so that the payoff to the principal results 
exclusively from the action of the agent, while the agents reward 
is determined solely by the principal according to the perceived 
results of the agent r s action. It is further assumed that the basic 
relationship between the two parties is formed for the benefit of 
both. Yowell investigates the extent to which the principal can 
guide the agent's action by establishing rewards conditional on the 
results the agent achieves. Tbu^ a prime characteristic of this 
approach is the agent's free choice of action. The basic assumption 
that endows the principal with control over the agent's action is 
the assumption that the agent maximi&es his profit (or, in the case 
of uncertainty, his expected utility). Without this assumption the 
rewards established would be meaningless. Rewards for results coupled 
with this prof it -maximizing behavior allow the principal tc influence 
the agent's behavior without, at the same tine, restricting the 
agent's free choice of action. 
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The basic elements of the problem are: 
x an action 

xeX wnere X is the set of possible actions 
h the payoff to the principal 
q the inducement cost to the agent 
r the conditional reward to the agent 
r€R where R is the set of possible rewards 
the profit of the principal 

(1) n t = h - r 
rr^ the profit of the agent 

(2) n 2 = r - q 
tt the joint profit 



(3) tt = Ttj + n 2 = h - q 

and the following definitions hold: 

Action : An irrevocable commitment of resources, such as effort, 

time, or money. "Action 1 * is used interchangeably with the term 
"dec is ion . " 

Cos t : Cost is taken to mean inducement cost, where the induce- 

ment cost q of an action xeX is defined as the amount of money re- 
quired to induce the agent to take the action x, and may be equated 
with the opportunity cost of the action x, i.e., the loss of profit 
from other opportunities by taking the action x. 

Incentive : A conditional reward, provided only if some stated 

result is achieved. "You will be rewarded with A if you accomplish 
B." 

Conditional Reward : The conditional reward is a scalar function 

of the two variables, payoff h and cos'" q: r(h,q). As a special 
case, the conditional reward may be defined in terms cf only one of 
the two variables, h or q. 

o 
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Thus , a particular action x will reeult in some particular, but 

k. k 

perhaps unknown, outcomes h and q , which will define a unique re- 

k 

ward r . (But note that the reward is based on the outcome, not on 
the action. This distinction is important when uncertainty is con- 
sidered, in which case there will correspond, to each action, one 
or more possible outcomes and consequently one or more possible 
rewards,! We can now define: 

Compensation : The agent is compensated for an action j if 

(4) r J - q J ^ 0 . 

If the equality holds, then the agent is exactly compensated. 

Weak Motivation : The agent is defined to be weakly motivated 

to take an action j in preference to all other actions k if the re- 

I 1 n 

ward vector r = (r , ..., r ) is such that 

i 

j (5) r J - :> r k - q k for all k. 

i 

j Strong Motivation : The agent is defined tc be strongly tuuti- 

vated to take an action j if the reward vector r is such that the 
strict inequality holds in (5). 



THE INCENTIVE PROBLEM UNDER CERTAINTY 

In the case of certainty f the payoff h and the cost q will be 
related uniquely with each activity x. They will thus be expressed 



as 




<C) 


h - h(x) 


(7) 


q - q(x) 
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It Is assumed that each party will seek to maximize his profit 
with the variables under his control. The principal can adjust the 
reward each possible outcome of payoff and cost which the agent 
might produce, while the agent, in viewing the array of rewards es- 
tablished by the principal and his own costs, can select that action 
which maximizes his profit. 

Yowell then assumes that a finite number, N, of alternative 
actions are available to the agent. Let X = , . .., x^) be the 

set of these actions x , k=l N. Under conditions of certainty, 

k k k 

each action x will result in a particular outcome h and q . The 

problem of the principal is to specify the reward vector, r = {r*\..r n }, 

where 

(8) r k r(h\q k ) k = 1 N, 

so as to maximize his profits. 

k 

How does the principal decide on the values of r ? First, he 
will assume that he must provide a reward at least as great as the 
agent’s cost; otherwise, the agent would receive a negative profit 
and would not accept the bargain. Thus for a desired action j, 

(9) n 2 = r J - q J ^ 0. 

Second, the principal knows that the agent is a profit-maximizer, 

and will take this knowledge into account by assuming that the agent 

will take whatever action maximizes his own profit. Hence the principal 

k k 

assumes that the agent will select the action J that maximizes r - q , 

i.e. , 
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( 10 ) 



k k 

j max r - q 
k 



Formally, Yowell states the principal's problem in deciding on the 
values of r^ as: 



PROBLEM I . 



(i) 






= h J 



- r J 



0} 



(r J 



r n )eR 



where 



(il) j max (n = r k - q k }. 

k z 

In words, Problem I states that the principal selects a set of re- 
wards (r\ . .., r 11 ), corresponding to each payoff ((h\q*), . 

(h n ,q n )), which maximizes his own profit through the action which 
the agent is motivated to take by the set of rewards. The constraint 
of I(i), which corresponds to (9), provides that the reward for the 
desired action j will be at least as great as the agent's cost, and 
the constraint I(ii), which corresponds to (10), accounts for the 
agent's prof it -maximizing behavior. An additional constraint could 
be imposed--the requirement that the principal's profit be nonnega^ ive -- 
but this would add little to the results. Yowell then proves two 
theorems associated with Problem I. 

Theorem 1.1 . There exists a reward vector r = (r*, r n ) 

such that the agent can be motivated to select the action J correspon- 
ding to any desired outcome (h^,q^) t 

This reward vector, of course, has the properties 
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< U ) r j :.qJ, and r k * q k , for k d j. 

The solution to the principal’s problem is, therefore, to pick the 
x J that maximizes joint profits and to set up a reward vector with 
the properties 

= qj and r^ < q k for k ^ j , 

since his profit is maximized when the aunt’s profit is set at zero. 

The next result applies to a linear reward function of the form 
r = a + cv h. Whereas Theorem 1.1 guarantee* that any outcome (h^,q^) 
can be motivated using a reward function such that (11) is satisfied, 
the next result guarantees only that the action which maximizes joint 
profit can be motivated when using a linear reward function. 

Theorem 1.2. Let j maximize the joint profit it a ti + . q 

and let the reward function be linear with r(h) = a + oh. The decision 
j will be motivated if and only if 

(13 > a q j - q k for h j > h* 

h j - h k 

and 

<“> * . q j - o k for h j < h k . 

h J - h k 

lurthermore, a value of O' £ 1 can be found to satisfy (13) and 
(14). Y owe 11 ’s proof also shows that a = 1 will always satisfy (13) 
and (14). 
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This lead*- to a solution of the form, 

(15) r - qj + a[h k - h J ], 

where x^ fs the joiur prof it -maximizing action and where x must satisfy 
(13) and (14). For future reference, note that the linear reward function 
is linear in the payoff to the principal and not the cost to the agent. 

THE INCENTIVE PROBLEM UNDER UNCERTAINTY 

Uncertainty is introduced into the incentive problem through 

the uncertain outcomes that result from a given action of the agent, 

In the problem under certainty, for each action x there was a unique 

k k 

payoff and cost ojtcome (h ,q ), while in the problem under uncertainty, 
for each action x there is a set of possible outcomes (h,q) which are 
assumed to be described by a probability distribution f^(h,q). 

The simplicity of the incentive problem under certainty does 
not carry over into the uncertainty analysis, for the introduction 
of uncertainty requires the consideration of 

1) the rik attitudes of the two parties, 

2) the joint probability distribution on the outcomes, and 

3) changes that occur in the state of knowledge of the 
parties during the transaction. 

3 k 

The utility analysis is taken mainly from Pratt, If z is the 
number of dollars of income to a decisionmaker, then for any utility- 
function ll(z) the risk premium I is defined by 

(16) e[u(z)3 = U(E[z] - I), 

* 

J. W. Pratt, ,f Risk Aversion in the Small and in the Large, 11 
Econometr ica , Vol. 32, Nos* 1-2, January - April 1964, pp. 122-136. 

ERiC 
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where E is the e;:pec tational operator. Given a utility function 
U(z) and a probability distribution function f(z), the expected 



Note that (16) defines the risk premium I implicitly by tne function 
U(z) and computed values E[U(z)] * nd e[zj. To r * sure that I is 
determined uniquely, Yowell always assumes that U(z) is monotonica lly 
increasing, and additionally that it is concave. 

The risk premium I depends on both the utility “unction U(z) 
and the probability distributi.n function f(z). For the utility 
function U(z), the risk tolerance function p(z) is defined by 



where a prime indicates differentiation with respect to the argument z. 

A risk-averse decisionmaker has a positive risk premium I, and 

a risk-preferring decis ionmaker has a negative risk premium I, The 

assumption that T J(z) is mono tonica lly increasing and concave implies 

that p(z) is positive; that is, the decisio.unaker is risk-averse and 

has a positive risk premium I. Two further definitions are required: 

Cautiousnto j is defined as the change in the r isk-tolerance 

* 

function brought about by an increase in income, i.e., p (z ) . 

R, Wilson, On the Theory of Synd i cates , Working Paper 71R, 
Graduate Business School, Stanford University, Stanford, California, 
August 1965; cited by Yowell, op, cit,, p. 38. 



values K['J(z)] and eLz] may be computed from 



00 



(17) 




z f(z) dz. 
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Aaditionally , it will be useful to distinguish an alternative 
x as distinct if its associated probability distribution f x (h,q) does 
not coincide with that of any other alternative xeX, i.e., there is 
no other alternative xeX such that f x (h,q) = f x (h,q) for all h,q. 

First Formulation: Identical Probability Beliefs on the Outcomes 

The risk attitudes of the principal and the agent toward un- 
certain profit ere described by their utility functions U^(-) and 
^(Oi where subscript 1 denotes the principal and 2 the agent. We 
assurre that both parties will maximize their expected utility of 
prof i t , 

The sequence of action within the problem consists of three 
parts; 1) the establishment of the reward function by the principal, 
2) the action by the agent, and 3) the provision of the agreed-upon 
reward based upon the revealed outcome, which is a function of both 
the agent*s action and the (uncertain) state of nature. The possible 
outcomes (h,q) that rejult from an action xeX of the agent are under- 
stood to be random variables described by a joint probability dis- 
tribution function x (h,q), with the subscript referring to the 
action x. In this formulation, both parties are assumed to hold the 
same probability beliefs on the outcome, i.e., both parties agree to 
each of the distributions t x (h,q) xeX. The behavioral assumptions 
are that the principal will select, fr^m the set R of allowable 
reward functions r(h,q), that reward function which maximizes his 
expected utility, while the agent will select the decision xeX that 
maximizes his expected utility. The decision x will in general de 
pend upon the incentive function r(h,q) selected by the principal. 
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Fur thermore : we postulate for Lhe agent an acceptance level A of 
expected utility, i.c., for the decision x selected by the agent, 
the expected utility must be greater than or equal to the acceptance 
level A; otherwise the agent would not enter into an agreement with 
the principal. Formally, these assumptions can be stated as: 



where E is the expectation operator with respect to the probability 
x 

distribution f x <h,q), and R is the class of functions r(h,q>. 

Note that the upper maximization is the principal's problem of 
selecting the optimal reward function, while the lower maximization 
is the agent's problem of se 1 ecting the optimal decision x as moti- 
vated by the reward function r(*)» The principal's choice of an 
optimal reward function rf*) is made with the knowledge that the 

agent will react to any selectel reward function in such a way as 

5 k 

to maximize his (the agent s) expected utility. 

Note that in the maximization of Problem 11, for any monotonically 
increasing function U (z), the maximization of Etu(z)] = U(eCz1 - I) 
from (16) may be accomplished by maximizing the argument Elx ] - i. 

Hence we may restate the incentive problem under uncertainty as: 



PROBLEM II. 



(i) max 
reR 




(ii) x maximize E 
xeX X 



Problem Ila. (i) 




(ii) 
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If we restate the constraint 1 1 ( i i ) as 



WV " F *W 



X€X 



Problem II may be written equivalently as 



where B is defined as 



B s U 2 (A 1 . 



Furthermore, if the constraint in Ila(i) is active, 



And 



so that 



and 



E n - - B. 

x 2 l 



<5 n « E h - E t 

X 1 X x 



E x r Jt - E x r - E >* 



Er c Eq + I~+B 
x 2 



E - 1= E h * E q - I • I 0 - B, 
x 1 1 X x n i. 2 



Then Problem Ha can be rewritten as 



Problem lib. 



M reR i E x h ' V* ' r i ' '2 ' *} , 



where 



(11> 21 “* {v - v ■ *i} 



Thus, the principal^ problem in Problem II may be interpreted as the 
selection of a reward function that maximizes Joint profits (E^ h - 
E x q) ratnus the cost: of uncertainty (I ^ ~ 
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I 

( 



Problem II. 



subject to 



max J 
rcR l 



E IT 
x 



1 



( V lE xW 




E U 9 {ti_) * E U,(n„) xeX. 
x 2 2 xl 2 

As now written, Problem II suggests a Ligrange multiplier solution; 
consequently, we define the Lagrange function L as 



(19) Ux.r.X.U) = E^TTj) + X[E x U 2 lTT 2 )-A] + £ 



xeX 



H tE U,(tu) 
x x 2 l 



VW’ 



where 



U = W : xeX] 
x 



Is the set of multipliers, which contains a multiplier for each 
alternative xeX, For convenience, it is assumed that the set X is 
finite, consisting of N alternatives. 

To solve Problem II, we solve the equivalent saddle value 
problem of finding x°, r°, X°, and u° = {k°, xeX } such that 

(20) min max L(x,r,X,^) * L(x° jr 0 ^ 0 ,^ 0 ) , 

X ^ 0, \x > 0 xeX, reR 

where the notation pi ^ 0 will denote pi £ 0 for xeX. Let us now 

x 

characterize the action x°, which satisfies the saddle value problem 
(20), by the lollowlng theorem: 

Theorem II . 1 , The action x° which is preferred by the principal, 
and consequently satisfies (20), has 
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< 21 > 'xtW + (»° * £ y “Sw] ' 

— xeX 

E x[ U l ( "l> + ( l ° + E v “x)w] 

- xeX 
for xeX . 

Theorem II. 1 states that the principal prefers the action x° 
which maximizes an arpropr ia te ly weighted sum of the expected utilities 
of the two parties. 

It will be useful to single out those alternatives that play 
a part in the determination of r° as "competing al terna t ives /' for 
these alternatives are essentially in competition with the alternative 
desired by the principal. 

Competing Alternative . An alternative x is a competing 
alternative with respect to the alternative *° preferred 
by the principal, if n > 0 in the solution of the saddle- 
value problem (20). X If = 0, then the alternative x 
is not competing. 

To see the origin of the defined term, consider an alternative x 

that is not competing. From the theory of mathematical programming, 

the Lagrange multiplier associated with an inequality cunstraint must 

be zero if the constraint is not active, while the constraint must 

* 

be active if the multiplier is positive. Thus, if the constrai it 
corresponding to the alternative x in (18) is not active, i.e., the 
equality does not hold in the constraint, then 

E x °U 2 (r° - q) > F x W 2 <r ° * 



Tlf 

H. W, Kuhn and A. W, Tucker, 1f Nonlinear Programming, 11 in J, 
Neyman (ed . ) , P roceedings of the Second Berkeley Symposium on Mathe- 
matics, Statistics and Probsbill i;ies , University of California Press, 
Berkeley, Wb 0 , ppt Adi- , 
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and the multiplier must be zero. Now, the inequality above states 
directly that the expected utility of the agent is greater for x° 
than for x, so that the agent does not prefer x and x is thereby not 
a competing alternative. 

Competing alternatives arise because of differences in the 
utility functions of the principal and the agent. rhis is illustrated 
by the following theorems of Yowell. 

A. If there are no compe ting^ alternatives : 

Theorem II .2 . The optimal reward function is of the form 
r(h,q) = q + g(^) for f(h,q) > 0, where q is the observed cost, and 
g(^) is some function of joint profit n, with n defined as t? = + 

n 2 = h - q. 

Theorem II » 3 . The function g(^) is a strictly increasing 
function of n if both parties have positive risk tolerance. 

Theorem 11,4 . The function g(r) is linear in the joint payoff 
r! if and only if the principal and the agent have identical cau- 
tiousness, l , e . , p' 1 (Ti - TT^) = P*2^2^* 

B. If there may be competing alternatives : 

Theorem II. 5 . Assume there is uncertainty on the outcome 
(h,q) f or a distinct preferred alternative x\ The optimal reward 
r° is a function of the form 

r(h,q) - q + g(^) 

for 

f o (h,q) > 0 



o 

ERIC 

* . » 
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if and only if in solving the stddle-value problem (20), 

= 0 xcX. 

x 

Theorem 11,6 . For any set of alternatives, the opf'mal reward 
for Pioblem 11 is identical to the optimal reward when there are no 
competiig alternatives if and only if both parties have identical 
cautiousness . 

An additional definition is required for the final theorem 
associated with Problem II. 

Mutually Exclusive Outcome . The outcome h^q 1 for an alterna- 
tive described by f x (h,q) is mutually exclusive wj.th the outcomes 
(h,q) described by f x (h,q) if f^h'jq 1 ) = 0. 

Theorem II. 7 . If the possible outcomes of the desired alterna- 
tive x C and at least one outcome of each of the remaining alternatives 
xeX are mutually exclusive, then there can be no competing alternatives 

i.e., u « 0 xeX. Under these conditions the optimal reward function 

* x 

is obtained for the outcomes of the desired alternatives by specifying 
a reward function consistent with the principal's preferences, and 
for the mutually exclusive outcomes by penalizing at least one of 
these outcomes so as to induce in the agent a preference for the 
(principal's) desired alternative. To see that this is true, denote 
the desired alternative by x° and the set of undesired alternatives 
by X. Since there is at least one outcome for each of the alterna- 
tives in X that is mutually exclusive with the outcomes of the 
alternative x^, the reward function may be established independently 
over the undesired outcomes. For any re nd function r° defined 
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over the outcomes (h,q) of the desired alternative, it is possible 
to define r° over the outcones (h,q) of the remaining alternatives 
in such a way as to make 

E (r - q) > E (r - q) xeX 
x 

by imposing a sufficiently large penalty on at least one of the 
mutually exclusive outcomes of the remaining alternatives, and this 
implies that = 0 for xeX. 

As a consequence of Theorems II. 2 and II. 7, the optimal reward 
for the desired alternative x° f s of t ^ ie f° r ™ 

r (h , q ) - q + g(n) for f o (h>q) > 0 > 

x 

while for the outcomes of the undesired alternatives it is not 
defined uniquely, being required only to sufficiently penalize the 
undesired outcomes. As far as the theory goes, a sufficiently large 
penalty on at least one of the mutually exclusive outcomes for each 
alternative would be quite satisfactory for optimality. 

Second Formulation: Different Probability Beliefs 

The relationship between principal and agent that has been 
developed is clearly asymmetrical in the sense that the agent has 
complete control over the action while the principal hfs complete 
control over the reward function. Furthermore, it can be expected 
that the coat q would be determined largely by the agent on the 
basis of his value system, while the payoff h would be determined 
almost exclusively by the principal on the basis of his value system, 
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It is reasonable that the asymmetry of this relationship might 
result in differing probability beliefs on payoff and cost, and 
indeed it might be argued that in the real world differing beliefs 
are more likely than not. 

Yowell states the problem of determining the optimal reward 
function when differing beliefs exist as 



PROBLEM III. 


U) 


irtfx J 
reR T 






(ii) 


x max 





xeX 



where 

00 c 

E J U i (T ’i ) = j J U i ( V £ x (h ’ q) dh dq 1 = 1,2 

1 2 
with f^(h,q) the probability belief of the principal and f x 'h,q) the 

probability belief of the agent for an action xeX. The superscript 

o 2 the expectation operator denotes expectation with respect to the 

probability assessment of the indicated party, 1. or 2. R is the 

class of function r(h,q). 

1 2 

For coincident probability beliefs, f (h,q) = f (h,q) and we 
have the results given iti Theorems II.2-II.4, which state that the 
optimal reward r° is a function of the form 



r(h,q) «= q + gC") 



with gi") an increasing function of and that g(^) linear if 
and only if the two parties have identical cautiousness. For 
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1 2 

differing probability beliefs, f (h,q) 7 f (h,q), and the earl er 
res jits no longer hold. The only result Yowell presents under these 
conditions is given by Theorem III.l, 

Theorem III.l . The optimal reward function is a function of 
the form 

r = q + g(") + g^(h,q) for f*(h,q) > 0 and f 2 (h,q) > 0 

with g( TT ) linear in rr and independent of h,q, and g (h,q) independent 
of ^ if and only if both parties have constant risk tolerances. 

Comparing Theorem III.l wi th Theorem 1 1.4, we see that when 
probability beliefs dif ;er, the special case of identical cautiousness 
with - P^C^) = constant risk tolerance, is required 

for a linear function g(n), The function g^(h,q) will not be linear, 
in general, as it depends directly on the probability distributions 
£ l (*) and f 2 (-). 

Yowell r s results concerning the form of the optimal reward 
function, while somewhat specialized, are nevertheless far more 
general than any other we have encountered. Section IV reviews 
the major articles on the theory of incentives for cost reduction, 
which is usually cited as the basis for most forms of government 
contracting. Yowell's general framework will bo retained in order 
to place these models in perspective. 
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IV. THE THEORY OF INCENTIVES FOR COST REDUCTION 



THE THEORY of incentives is concerned with the specification of a pay- 
off vector that will induce the agent to select and accomplish actions 
that the principal prefers. Almost independently, a theory of incen- 
tives for cost reduction has been developed. This latter theory, 
usually expressed in terns of the Federal Government and defense con- 
tractors can, however, be viewed as a specialization of the former. 

This section reviews the major articles on the theory of cost incen- 
tives and contrasts them with each other and with Yowell's more general 
model . 

Two features of the theory of ir jntives for cost reduction differ- 
entiate it immediately f row Yowe 11 1 s model. First, the assumption is 
always made that the payoff to the principal is fixed and given as a 
prerequisite of the problem. That is, 



which implies that we are interested no longer in the joint distribu- 
tion of outcomes f x (h,q), but only in the marginal distribution of 
costs f (q | h) . This assumption severely limits the applicability of 
this theory, as one of the prime characteristics of most performance 
contracting situations is the variability of the quality (performance) 
of the product. 



( 22 ) 



h = h 
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Second, the form of the reward function is specified as 
(23) r - C a + g(C a ), 

where C^ is the actual (direct) costs incurred in performance of the 
contract (and may or may not be equal to q, the inducement cost), and 
where g(C^) is usually linear in C^. Thus the form (and usually sev- 
eral parameters) of the reward function is specified and the problem 
is to select optimal values for the (remaining) parameters of the func- 
tion. 



SCHERER'S MODEL * 

In Scherer's model: 

a. The payoff to the principal is fixed and given, so that 
(24) W * V- ~ r > = D <r) # 

B. Although there is uncertainty concerning q, both parties base 
their decisions strictly upon the E(q). That is, 0^(O and l^O) are 
linear in money. 

C. 



(25) q - C + C , 

a o 

where represents the production cost of performing the contract in 
question and C q the associated opportunity (or, in Scherer's termi- 
nology, user) costs. 



* 

F, M. Scherer, The Weapons Acquisition Process: Economic Incen- 

tives , Harvard University Press, Boston, Hass., 1964. F. H. Scherer, 
Theory of Contractual Incentives for Cost Reduction," Quarterly 
of Economics , Vol. 78, Ho. 2, May 1964, pp. 257-280. 

36 s 
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D. Opportunity costs are linked to direct costs by the relation- 
ship , 

(26) C = b,(C„ - C ) + b,(C„ - C ) 2 with b_ , b> 0 

o Z t a Jta z j 

where is a predetermined constant representing the target production 

costs. Thus C is uncertain only because of the uncertainty associ** 
o 

ated with C . 

a 

E. The form of the reward function is specified as 

(27) r = C + tt 0 + aC - aC , 

a 2t t a' 

where C and C are as defined above, tt represents the agents allowed 
at z t 

target profit, and a represents the agent's sharing rate in production 

* 

costs above or below C^. a is restricted to 0 £ a £ 1. 

F. The relationship between target profit and the sharing rate 
is given institutionally as 

^28) tt 2 ^ 

G. C and at are controlled by the principal. 

The Agent's Problem 

Un’er tnese specifications, the agent's expected profits are 

(29) Er = E(r •• q) * Er(C ) - EC - EC (C ) . 

^ a a o a 

The agent's problem then is 



Observe t at this reward function does not correspond to any 
derived by Vowel 1. 

o 

ERJC 
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(30) 



max 

xeX 



E[U 2 (tv 2 )], 



which, because of the linearity assumption on , can be stated as 



(31) 



max 

xeX 



E(h 2 ). 



In other words, the agent is assumed to select the productive methods 

that result in an E(C ) that maximizes his expected profits* Substi- 
a 

tuting (26), (27), and (28) into (30) and assuming that the resulting 
expression is twice differentiable, Scherer shows that the agent will 
select x° such that 



(32) 



EC° * 
a 



c t + 



b 2 - 
2 b- 



Three properties of this result, are of interest* First , for any 

allowable (positive) values of b 0 and b~, EC° will reach its minimum 

l 3 a 

value when a is set at its maximum value of 1.0. Any lower value of a 

will increase EC c relative to C » (That is, a lower value of a will 
a t 

result in a reduced "cost underrun" or an increased "cost overrun.") 

Second , the higher the value of b^ for any given values of a and b^, 

the greater EC 0 will be in relation to C . When b 0 is greater than 
a t 2 

1.0, EC° will be larger than C and an expected cost overrun will be 
a t 

optimal, since a cannot ^xceed 1,0. T hird , even when a = 0, it cannot 

be said that the agent has no incentive for cost reduction, nt clearly 

^2 

has an Incentive to limit EC to that value at which it equals C + rr— • 

a t 2b ^ 



The Principal's Problem 

Scherer assumes that is determined outside the model, so that 
the principal’s piublem is to select a sharing rate a that will minimize 
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his expected expenditures on the contract. That is, 



(33) 



0 



Min 

< a < 1 



EtD^r)] s.t. 



EC = EC° 
a a 



which can be expressed as 



(34) 



Min 

0 £ a i 1 



Er[EC^(a) ,a] , 

3 



the solution of which is 



(35) 



1 + b- - 2a.,b, 
o _ 2 2 3 

“ 2 + 4a 3 b 3 



so 



long as a^ > 




Negotiations Over the Sharing Rate 

Scherer also investigates the case where the agent is able to ne 
gotiate (or at least express his preferences) over the value of the 
sharing rate (and hence over as tt^ =* The principal's 

preferred rate is given by (35). The agent's preferred sharing rate 
is determined by Solving 



(36) 



max 

0 < a < 1 



E(tt 2 ) . 



This yields 



(37) o b 2 ' 2a 2 b 3 

°2 * 1 + 4a 3 b 3 



and will be equivalent to the government's preferred rate only if 




b 2 - 1 + 2b^(a 2 + 2a^) . 



39 > ! 



(38) 
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Unfortunately , little can be sai concerning the preferred rate of 
either party cr the relationship between them. 

Risk and Its Allocation 

It is often stated that in Scherer’s model "risk" is allocated by 
the selection of the sharing rate a. This is true; bat it is not cor- 
rect to say that the principal (government) assumes all of the risk, 
or that the agent has no risk, when a = 0. Observe that for at = 1, 



(39) E[D 1 (tt 1 )] = E[D 1 (r) ] = ^ 

as E(r) - EC^ + ti^ + - E(C^) = ^ “ a constant 

and 

(40) E[U 2 (tt 2 )] = E(ir 2 ) 

as E(tO = C + tt - EC - EC . 

2 t Zt a o 

That is, when ot » 1 the agent bears all of the risk. For a = 0, how- 
ever , 

<*1> E[D 1 (7 t 1 )] - E[Dj(r) ] 

as E(r) =» TT 2t + EC a 



and 



(42) 



E[U 2 (?r 2 ) | « E [ TT 2 3 

as E (tt ) = + EC - EC - EC ■ tt + EC . 

2 2t a a o 2t o 




That is, when a - o the principal bears all of the risk associated with 
production costs, but the agent retains the risk associated with the 
user or opportunity costs. 

4o:< 
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It should also be noted that this allocation of risk is completely 
incidental to Scherer's analysis, since both parties are assumed to be 
indifferent to whatever risk is present and to ignore it in their de- 
cision. Furthermore, the amount of risk present is determined outside 
the model by the specification of h (which specifies f x (q|h)), and the 
expected level of profits is partially determined outside the model by 
the specification of C^. Hence, Scherer's model says very little about 
decisionmaking under uncertainty. In particular the model does not 
investigate either parties 1 preferences among 

a) risk assumption and size of risk, 

b) risk assumption and expected size of profits, or 

c) size of risk and expected size of profits. 

INTRILIGATOR f S MODEL 

In 1964, Intriligator developed a model that incorporated uncer- 
tainty into the theory of incentives for cost reduction. He focused 
directly on the problem of developing preferred sharing rates, ignoring 
the agent's production decisions. His model can be formulated as fol- 
lows. 

A. The payoff to the principal is fixed and given, so that 

(43) UjC^) = U x (h - r) E V^r), 

where V^(r) is the principal's utility function. 

B. Both parties possess quadratic utility functions and both are 
risk averse. That is, 

*M. D. Intriligator, "Optimal Incentive Contracts," unpublished 
paper, 1964. 
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(44) 



V 1 (r) = Vj + v 2 r + v^r 



and 



C. 



with V|(r) = v 2 + 2v^r < 0 



and 



V^(r) = 2 v 3 < 0, 



(45) 



U 2^2* = U 2^ r “ O “ + u 2 ( r • q) + u 3 (r “ q) i 



with U^r - q) = + 2u^(r - q) > 0 



and 



U”(r - q) - 2 u 3 < 0. 



(46) 



q - c 



where is inducement cost and is uncertain. The marginal distribu- 
tion of q is f(q|li) and,, since Vj(') and ( * ) are quadratic, this dis- 

2 

tribution can be represented by u and o . 

D. The form of the reward function is specified as 



(47) r = C + tt + aC - aC 0 £ a s. 1. 

a Zt t a 

E. and t are specified outside the model. 

The Agent T s Problem 

Under these conditions the agent's problem of selecting a pre- 
ferred sharing rate can be stated as 



max 

0 s a 4 1 



V f E 2 (r - q)]. 
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Using (45), (46), and (47) and designating the agent'f, probability 

2 

beliefs on C as and a 0 , the solution is 
a L i 



(48) 



o 

a 2 



<“z - C t> 2 * «2 



This preferred sharing rate for the agent has the following properties 

1) The preferred sharing rate depends on target profits and 
costs, parameters of the contractor*? utility function, and the mean 
and variance of the contractor's cost density function. 

2) By the assumptions about the agent's utility function, the 
preferred sharing rate is positive if: 



that is, if target costs exceed expected costs (an expected cost under 
run) . 

3) The preferred sharing rate is zero if target costs equal ex- 
pected costs. 

4) An increase in the agent's variance, reflecting increased 
uncertainty about costs, leads to a decrease in the preferred sharing 
rate. 

5) An increase in target profits also leads to a decrease in 
the preferred sharing rate* 
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The Principal's Problem 

The principal's problem of selecting the sharing rate that he 
prefers can be stated as 



max 

0 * a £ 1 



V 1 [B 1 (r)]. 



Using (44), (46), and (47) and designating the principal's probability 

2 

beliefs on C as \i . and a, , the solution is 
a 1 1 



(49) 



(Ui 



V 



(ll 




+ 



2 




+ v 1 ) + o 



2 

1 



and has the following properties: 

1) The principal's preferred sharing rate depends on target 
profits and costs, the parameters of the principal's utility function, 
and the mean and variance of the principal’s probability density func- 
tion. 



2) The principal's preferred sharing rate is positive if 



(50) 



\l < — 
1 V 



2 

2v„ 



*2t + V 1 



Since v^ is assumed to be negative, the right-hand side of (50) is posi- 

v 

tive if v 2 is negative or if < n t + If the right-hand side is 

positive, then target costs less than (the principal's) expected costs 
(an expected cost overrun from the principal's point of view) is suf- 
ficient but not necessary for a positive sharing rate. 
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3) The preferred sharing rate is 1.0 if target costs equal ex- 
pected costs. 

4) An increase in the principal's variance, retj.. itig increased 
uncertainty about costs, leads to a decrease (increase) in the pre- 
ferred sharing rate if there is an expected cost overrun (underrun). 

5) An increase in target profits leads to a decrease (increase) 
in the preferred sharing rate if there is an expected cost underrun 
(overrun) . 

Comparing (48) with (49) we can see that, in general, the agent's 
preferred rate will differ from the principal’s preferred rate. The 
actual sharing rate incorporated into a contract might be expected to 
fall somewhere between these two rates, and to depend on the relative 
power and bargaining skills of the two parties. 

Identical Pr ob ability Beliefs 

In the special case of identical probability beliefs, that is, 

where 



(51) 



~ ;J 2 ’ ^ and 



(52) 




2 

o , 



the two preferred sharing rates will be related by 



(53) 



o > o 

°2 <T °1 as 





Now, v^ < 0, u^ < 0, and u^ is necessarily positive, so again the 
rightmost expressi^.i is positive if < 0. Assuming this is true, 
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target costs nvjst exceed expected costs (an expected cost underrun) 
for thp preferred rates to be equal. A larger expected underrun would 
result in the agent's preferred rate being greater than the principal’s 
preferred rate. A small expected underrun or an expected overrun 
( C ^ - u < 0) would lead to < ct^ ■ 

BERHOLD'S MODEL 

* 

Berhold expanded the treatment of uncertainty in 1967. He did 
not discuss Intri ligator ' s problem of negotiations over the sharing 
rate, but returned to Scherer's basic formulation, where the principal 
selects the sharing rate from a knowledge of the agent’s profit- 
maximizing behavior. 

In Berhold's model: 

A. The payoff to the principal is fixed and given, so that 

(54) W = V r) * 

B. The cost to the agent is composed of actual costs and 
opportunity costs C^, so that 

(55) q * C + C . 

i o 

C. The reward function is of the form, 

(56) r « C + + aC - aC with 0 < a S 1, 

a IX. t a 

k 

M. berhold, An Analysis of Contra ctua l Incent ives, Working Paper 
129, Western Management Science Institute, University of California, 

Los Angeles, September 1967. 

o 
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so that 



(57) 



r - 
r - 





aC 

a 



C . 

o 



Berhold assumes that the principal selects values for , TT 2t > 
and a at some point in time At some later time, t 2 > the agent 

selects an action x and, hence, a ?evel of (expected) cost q. Both 
parties seek to maximize their respective utility. He investigates 
the model under conditions of certainty at both t^ and t£> under con- 
ditions of uncertainty at t^ and certainty and t^, and under conditions 
of uncertainty at both t^ and t^. He also investigates the model under 
a variety of utility assumptions for the principal and the agent. 
Throughout Berhold's work the emphasis is upon the derivation of the 
principal's preferred sharing rate a°. In its most general formula- 
tion, hts problem can be expressed as the principal's problem: 



(58) 



Max 



C t* TI 2t ’ ° 



{E 1 lU 1 (ir 1 )]|E 2 lU 2 (ir 2 )] > A} 



subject to (the agent's problem): 



(59) 



Max e 2 (u 2 (* 2 )]. 

xeX 



His procedure is to solve (59) for x°, and then to solve 



( 60 ) 



Max 

0 i Q S 1 
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